Relative geometry-aware siamese neural network for 6DOF camera relocalization
نویسندگان
چکیده
6DOF camera relocalization is an important component of autonomous driving and navigation. Deep learning has recently emerged as a promising technique to tackle this problem. In paper, we present novel relative geometry-aware Siamese neural network enhance the performance deep learning-based methods through explicitly exploiting geometry constraints between images. We perform multi-task predict absolute poses simultaneously. regularize shared-weight twin networks in both pose feature domains ensure that estimated are globally well locally correct. employ metric design adaptive distance loss learn capable distinguishing visually similar images from different locations. evaluate proposed method on public indoor outdoor benchmarks experimental results demonstrate our can significantly improve localization performance. Furthermore, extensive ablation evaluations conducted effectiveness terms function.
منابع مشابه
Random Forests versus Neural Networks - What's Best for Camera Relocalization?
This work addresses the task of camera localization in a known 3D scene, given a single input RGB image. State-of-the-art approaches accomplish this with two steps. Firstly, regressing for every pixel in the image its so-called 3D scene coordinate and, subsequently, using those coordinates to estimate the final 6D camera pose via RANSAC. To solve the first step, Random Forests (RFs) are typical...
متن کاملGated Siamese Convolutional Neural Network Architecture for Human Re-identification
Matching pedestrians across multiple camera views, known as human re-identification, is a challenging research problem that has numerous applications in visual surveillance. With the resurgence of Convolutional Neural Networks (CNNs), several end-to-end deep Siamese CNN architectures have been proposed for human re-identification with the objective of projecting the images of similar pairs (i.e...
متن کاملPolar Sine Based Siamese Neural Network for Gesture Recognition
Our work focuses on metric learning between gesture sample signatures using Siamese Neural Networks (SNN), which aims at modeling semantic relations between classes to extract discriminative features. Our contribution is the notion of polar sine which enables a redefinition of the angular problem. Our final proposal improves inertial gesture classification in two challenging test scenarios, wit...
متن کاملMapNet: Geometry-Aware Learning of Maps for Camera Localization
Maps are a key component in image-based camera localization and visual SLAM systems: they are used to establish geometric constraints between images, correct drift in relative pose estimation, and relocalize cameras after lost tracking. The exact definitions of maps, however, are often application-specific and hand-crafted for different scenarios (e.g. 3D landmarks, lines, planes, bags of visua...
متن کاملSummarizing Image/Surface Registration for 6DOF Robot/Camera Pose Estimation
In recent years, 6 Degrees Of Freedom (DOF) Pose Estimation and 3D Mapping is becoming more important not only in the robotics community for applications such as robot navigation but also in computer vision for the registration of large surfaces such as buildings and statues. In both situations, the robot/camera position and orientation must be estimated in order to be used for further alignmen...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neurocomputing
سال: 2021
ISSN: ['0925-2312', '1872-8286']
DOI: https://doi.org/10.1016/j.neucom.2020.09.071